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20  AaSTRACT  (Conthmo  m toporco  cldo  It  nceoccmry  mg  Igmtity  by  block  numbor) 

We  characterize  those  transformations  (Uj^l,  (Vj^)  where 

2^l(Ui]  (Vi)  ■ R , where  R is  given  in  advance.  Related  character! 

zatlons  are  given  for  sums  of  the  form  L.U.®V.  . 
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In  a previous  paper  [2]  we  studied  the  (decomposable) 
Kronecker  product  A ® B of  finite  rank  linear  transforma- 
tions A and  B on  complex  Hilbert  space,  and  the  relation 
to  (decomposable)  dyadic  products  (U][V)  , where  U and  V 
are  also  finite  rank  linear  transformations.  (Definitions 
of  these  products  are  In  the  following  section.)  In  partic- 
ular, we  characterized  those  linearly  Independent  families 
with  the  property  that 

S (U.][V.)  - A ® B*^  (1.1) 

1-1  ^ ^ 

for  given  transformations  A and  B . (B^  denotes  the  trans- 

pose of  B .)  In  this  paper,  we  extend  the  analysis  of  (1.1) 
by  characterizing  the  generating  sums 

S(U.][V.)-R  (1.2a) 

1_1  1 1 

N 

E (U.  ® V.)  » S (1.2b) 

1_1  1 1 ~ 


where  R and  S are  general  linear  transformations  and  not 
Just  decomposable  Kronecker  of  dyad  products.  Thus,  this 


paper  Improves  upon  [2]  In  the  three  respects: 

(a)  The  sums  (1.2a)  and  (1.2b)  are  more  general. 
Moreover,  they  will  be  characterized  without 


assuming  linear  Independence  of  the  families 


1 


2 


I 

F 


fUll  * {Vj^}  . (Th.  3.2.) 

(b)  The  relations  among  the  transformations  R , 

S t , {Vj}  will  be  natural  in  the 

sense  that  they  do  not  depend  on  particular 
matrix  representations  of  the  functions  in 
question.  This  matrix  dependence  was  used 
in  [2]  in  the  analysis  of  (1,1). 

(c)  We  show  a duality  between  the  operations 

"][*'  and  , so  that  characterizing 

(1.2a)  is  equivalent  to  characterizing 


(1.2b) . (Th.  4.2,  4.3.) 

We  briefly  mention  one  motivation  for  studying  equations 
of  the  form  (1.1).  If  A * ^®ij)  ® each 

2x2  scalar-entried  matrices,  then  the  classical  definition 
of  matrix  multiplication  says  that  the  four  entries 


ik 


2 

r (a 
j-1 


ij 


(1.3) 


of  the  matrix  product  AB  generally  require  eight  scalar 
multiplications,  viz.,  the  eight  products  (a^j  • bjj^)  , i , 
j,  k"l,  2.  In  the  landmark  paper  of  Strassen  [5] , he 
shows  that  there  are  seven  scalar  products , (aj^j^  + a22)  * 

^11  ^12^  » ^*11  *12^  * ^22^  ’ etc.,  whose  sums  and 

differences  suffice  to  produce  the  four  scalars  c^^^  of  (1.3). 
Now  in  [3]  it  is  shown  that  if  A and  B are  consistent 
rectangular  matrices  (i.e.,  AB  is  defined),  and  if  I is 
an  identity  matrix,  then  the  scalars  c^^^  of  AB  each  iden- 
tify with  a certain  Kronecker  product  ® I , while  the 


- 3 - 

generating  scalar  products  (such  as  ^ ^12^  * 

(ail  + aj^2)  • (^22^  »•••)  each  identify  with  a unique  dyadic 
product  (U] [V)  . To  minimize  the  number  of  scalar  products 
which  produce  all  entries  of  matrix  AB  is  equavlent,  there- 
fore, to  minimizing  the  number  of  dyadic  products  (Uj^]  [Vj^) 
whose  sums  and  differences  produce  all  the  Kronecker  products 
® I = r-  (U^][Vp  . From  (1.2a)  and  (1.2b)  we  derive 
some  interesting  special  cases. 


PRELIMINARY  RESULTS  AND  DEFINITIONS 


Families  {uj^}  , (vj^}  , 1-1,  2,...,N  in  Hilbert 

space  are  b ior thonorma  1 if  , the  Kronecker 

delta.  £{H,K)  denotes  all  bounded  linear  transformations 

sending  Hilbert  space  )(  to  Hilbert  space  X ; among  these 

« 

are  the  rank  one  dyads  (x  x y)  for  x e K , y c H , where 
for  all  z e X , (x  x y)  :z  -♦  <z,y)x  . The  adjoint  of 
A e £(H,K)  is  A*  (which  belongs  to  £(K,H))  and  is  defined 
by  <Ay,x>  - <y,A  x>  for  all  x c K , y c H . From  this 
we  see  that  for  (x  x y)  e £(H,K)  , A e £(K,H0  and 
B e £(H',H)  , we  have 

A(x  x y)  - (Ax  x y)  , 

and  (2 . 1) 

(x  X y)B  - (x  X B y)  . 

The  space  £(H,K)  accepts  an  inner  product  [ • , • ] defined 
by  [A,B]  - tr(B*A)  , the  trace  of  B*A  in  £(H,H)  , where 
A , B e £(H,K)  . The  dyad  of  transformations  A e £(Hj^,H2) 
and  B e £ (Kj^,K2)  is  denoted  by  (A][B)  , where 

(A][B):C  -»  [C,B]A  (2.2) 

for  all  C e £(Kj,K2)  . cf.  [4,  Ch.  5,  §5]. 

For  Hilbert  space  H , IT  denotes  the  Hilbert  space  of 
linear  functionals  on  H , where  for  x c H , x c IT  Is  given 
by 

x:y  -»  <y,x> 

- 4 - 


(2.3) 


I 

i 
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t 
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for  all  y e M . The  transpose  of  A e £(H,K)  is  that 

transformation  sending  K to  ff  defined  by  A*^(y)(x)  =»  y(Ax) 
for  all  xcH,  yc^.  As  a special  case  the  transpose  of 
a dyad  is  (x  x y)^  - (y  x x)  While  its  adjoint  is  (x  x y)* 

- (y  X x)  . If  A e , B e JC(Kj^,K2)  , then  the 

Kronecker  product  A ® of  transformations  A and  is 

given  by 

A ® B^;C  -»  ACB  (2.4) 

for  all  C e £(K2,Hj^)  . cf.  [4,  p.  211], 

For  any  transformation  A , the  symbols  rgA  and  n(A) 
denote  the  range  of  A and  the  nullspace  of  A , respectively. 
While  ^ denotes  the  orthogonal  complement  of  subsapce  M . 

If  M c H , then 

A e £(M,rgA)  c JC(H,H')  (2.5) 

will  mean  A:M  -*  rgA  cH',  McH,  and 

A:M^  ■*  0 , (i.e.,  M is  orthogonal  to  n(A))  . 

An  inqportant  relationship  between  the  dyad  and  Kronecker  prod- 
ucts is  given  by 

(x  X y)l[(u  X v)  - (x  X u)  ® (y  X v)  (2.6) 

for  all  X,  y,  u,  v in  (possibly  different)  Hilbert 
spaces,  cf.  [1,  p.  131].  Finally,  for  vectors  {X^:l  ■ 1 , 

2 ,...,  N)  the  symbol  sp(Xj^:l-l  , 2 ,...,  N>  or  sp(Xj^) 
will  denote  their  linear  span. 


THE  miN  RESULT 


l 

>. 


t 


I 

t 

I 
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We  now  characterize  the  terms  (Uj.][V^)  of  sum  (1.2a) 
given  transformation  R . The  following  terminology  will  be 
convenient 

Definition  3.1.  For  the  families  of  linear  transformations 
c £(Hj^,H2)  t {V^)  c je(Kj^,K2)  , we  define  their  respective 
ranks  r , r by 

ji  * ^ ^ 

r^  - dimension  (sp<U£>)  , 

(3.1) 

r^  » dimension  (sp<V£>)  . 

For  any  linearly  independent  family  {U^^}  , then  biorthonormal 
complement  to  (U^)  is  that  unique  linearly  independent  sub- 
set {Uj^}  of  sp<Uj^>  such  that 

A 

[Ui,Ujl  ■ S^j  , the  Kronecker  delta.  (3.2) 

Remark.  Biorthonormality  is  a natural  generalization  of 
orthonormality.  Indeed,  if  {U^^]  is  not  only  linearly  inde- 

A 

pendent,  but  orthonormal  as  well,  then  we  would  have  ■■ 
for  each  i . Also  suggestive  of  orthonormality  is  that  any 

A 

element  Z c sp(U^)  ■ sp(U^)  has  representation 

Z - B(Z,U£lUj^  - S[Z,Uj^]Uj^  (3.3) 

which  follows  from  (3.2). 

Theorem  3.2.  (1)  Given  any  linear  transformation 

R:£(Kj,K2)  -»  £(Hi,H2) 


6 
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(2)  Given  integer  k a 0 , and  any 
(r^+k)- element  set  of  transformations 
{U^}  , such  that  rgR  c sp<Uj^>  c £(Hj^,H2)  * 
where  (by  reordering  if  necessary)  the 
first  r^  elements  form  a basis  for 

• Accordingly,  if  k > 0 we  are 
given  unique  scalars  , defined 

by 

r 

“j  - 1 • 

r^  + 2 , . . . , r^  + k . 

(3)  Given  arbitrary  linear  transformations 
(for  k > 0)  , 

^ru  + 1 *^^ru+2  *****'^ru+k  ' 


We  conclude  that 


^S^(Ui][(V^)  » R , N - r^  + 


(3.4) 


if,  and  only  if,  each  ■ £(Kj^,K2)  » i - 1 , 2 , . . . , r^  , 

is  given  by 


Vi  - R*(Uj^)  - S , i - 

^ ^ J-r  +1  ^ J 


1 . 2 r 


(3.5) 


where  .N  ■ r^  + k , and  the  scalars  are  defined  in 

Hypothesis  (2)  . If  k - 0 , then  ■ R* (Uj^) 

Proof  (3.4)=»(3,5).  We  apply  both  sides  of  (3,4)  to  ar- 
bitrary Z c £(K^,K2)  to  obtain 


S [Z,V^lU^  - R(Z)  c rgR  . 
1.1  1 1 ^ 


j We  reformulate  (3.6)  as  follows,  where  N =*  r^  + k : 

j For  all  Z c £(Kj^,K2)  , 

I N 

s [z,v.lu.  + E [z,vJu.  » R(Z) 
i-1  ^ ^ ^ ^ '■ 

E [Z,v^  + E - R*(U^)]U.  = 0 . 

1-1  ^ ^ j ~ 1 i 

This  last  equation  is  obtained  by  substitution  of  equations 

i 

■ for  the  Uj's  (Hypothesis  (2))  and  (3.7)  This  implies  that 

N 

■ V<  - R*(U,)  - S , 1 - 1 , 2 r , 

M 1-1  1 3 u 

i»  which  establishes  that  (3,4)=^ (3. 5) . 

> (3.5)-(3.4) : Substitute  (3.5)  into  (3,4)  and  the  proof  is 

i by  verification.  This  ends  the  theorem, □ 

Remark.  We  note  that  our  Hypotheses  (2)  vdierein  we  as- 
svime  sp(Uj^)  3 rgR  , is  also  a necessary  condition  if  (3,4) 
is  to  obtain.  This  is  immediate  from  (3.6).  Finally,  we 
observe  that  Theorem  3.2  is  the  generalization  of  [2,  Th.  3.1] 
which  replaces  R with  A 0 and  requires  linear  inde- 
pendence of  the  families  (U^)  , {V^^}  . 


A 'DUALITY  THEOREM 


I 


Having  completely  characterized  compenent  terms 
for  sums  (3.4),  we  raise  the  question  whether  a characterization 
is  possible  with  terms  of  the  form  , i.e.,  if  "®" 

replaces  ”]["  . With  minor  modification,  (3.4)  is  equivalent 
to  such  a sum.  In  developing  this  idea,  we  come  to 

Definition  4.1.  Given  U e £(Hj^,H2)  , V c X(Kj^,K2)  . 

Then  the  linear  transformation  0 is  defined  by 

0 (U] [V)  = U ® V (4.1) 

(linear  extension  defines  0 on  sp((U][V)>  . 

We  present  the  theorem  which  says  that  in  (4.1),  oper- 
ations ”][**  and  ”®''  may  be  interchanged. 

Theorem  4.2.  The  equat ion 

0 (U][V)  = U ® 7 (4.1) 

is  valid  for  all  U e X(Hj^,H2)  , V e £(Kj^,K2)  if,  and  only 

if, 

0 (P  ® Q)  = (P][^)  (4.2) 

for  all  P e X(K2»H2)  , Q e X(K^,Hj^)  . 

Proof.  Without  loss  of  generality  (due  to  linear  exten- 
sion) , we  may  suppose  U , V , P and  Q are  all  rank  one 
transformations.  Now  set 


i 

\ 
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U » (U2  X Uj^) 

V « (V2  X Vj^) 

P » (U2  X V2> 

Q » (u,  X Vi) 


Uj^  € , 

Vj^  c Kj^  , 


U2  c H2 
V2  c K2 


Then 


0(U1[V)  = U ® V 


js  0(  (U2  X Uj^)l[(v2  X Vj^))  = (U2  X u^)  ® (V2  X 

Si  0((U2  X V2>  ® (Uj^  X Vj^))  - (U2  X V2)][(uj^  x Vj^)  from  (2.6) 

Si  0(P  ® Q)  - (P][<J)  . 

Since  the  above  equations  hold  for  rank  one  transformations, 
linear  extension  guarantees  validity  for  arbitrary  finite 
rank  transformations,  and  the  theorem  is  proved. a 

An  immediate  application  of  this  result  is  a dual  formu- 
lation of  Theorem  3.2,  which  we  state  without  proof. 

Theorem  4.3  (dual  to  Th.  3.2).  Given  Hypotheses  (1),  (2) 
and  (3)  of  Theorem  3.2  then 


E (U.][(V.)  - R 
i-1  ^ ^ 

if,  and  only  if, 

L ® =-  0 (R^ 

where  0(X][Y)  ■ X ® Y , 
if,  and  only  if, 

V.  - R*(U.)  - E 1 2 r 

1^1  1 i j»  i ^ 9 •••  9 • 

J u 

Remark.  One  difficulty  with  Theorem  4.3  is  that  although 
we  may  know  a good  deal  about  R , we  may  not  be  able  to  under- 
stand the  precise  form  of  0(^  • In  the  next  section,  we 
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present  applications  and  special  cases  where  this  difficulty 
does  not  arise. 


SOME  APPLICATIONS  AND  SPECIAL  CASES 


The  case  {Uj^}  is  linearly  independent. 

Theorem  5.1.  If  R is  a linear  transformation  of  fi- 
nite rank  M , and  if  lUj^,U2 Uj,)  i«  • basis  rgR  , 

* 

then  there  is  one  and  only  one  basis  

such  that 

M 

C (U.1[(V.)  - R . (5.1) 

i-1  ^ ^ 

In  fact, 

- R*(Ul>  i ■ 1 » 2 ,...,  M . (5.2) 

Proof.  This  is  just  Theorem  3.2  when  k ■ 0 . 

Now  Theorem  5.1  gives  us,  as  a special  case.  Theorem  3.4 
of  [21,  which  we  state,  along  with  a dual  form  which  is  a 
consequence  of  Theorem  4.2. 

Theorem  5 . 2 (plus  dual  to  (2,  Th.  3.4]).  Let  A and  B 
be  linear  transformations  of  ranks  r and  s , respectively. 

Let  {U^,U2,...,Uj.g)  be  a basis  for  X(rgB*,rgA)  . Then 
there  is  one  and  only  one  basis  tVj^,V2, . • • ,Vj.g)  for  T(rgB,rgA  ) 
such  that 

S (U.IKV.)  - A ® B*^  , (5.3) 

i-1  ^ ^ 

which  obtains  if,  and  only  if. 


(5.4) 


S U.  ® V.  - (Al  [ B ) . 
i-1  ^ ^ 

Moreover , 

Vi  - A*UiB*  , i - 1 , 2 rs  (5.5) 

Proof.  Display  (5.3)  follows  from  (5.1)  with  A ® B^ 
replacing  R , while  (5.4)  follows  from  (5.3)  by  using  the 
the  duality  Theorem  4.2.  The  exact  form  (5.5)  for  the  Vi's 
follows  from  (5.2).  (We  note,  an  explicit  description  for 
the  ^i's  is  missing  from  (2,  Th.  3.4J.)  We  observe  that 
for  the  special  case  R ■ A ® B^  , we  have  rgR  » £(rgB*,rgA) 
and  rgR  - £(rgB,rgA  ) (cf.  (2.5))  so  that  the  hypotheses 
of  Theorem  5.2  are  consistent  with  those  of  Theorem  5.1;  and 
the  proof  Is  done.o 

The  case  R - 0 . 

We  raise  the  question:  When  do  dyads  or  (with  help  of 

Th,  4.2)  Kronecker  products  sum  to  zero?  We  remark  that  an 
answer  to  this  question  Is  an  answer  to  the  question:  When 

do  dyads  (resp.  Kronecker  products)  sum  to  another  dyad  (resp. 
Kronecker  product)?  This  is  clear  since 
N N-1 

^L^(UiHVi)  - 0 **  ^S^(UiH(Vi)  - -(V^V  • 

For  the  statement  of  the  next  theorem,  we  will  not  need  the 
fact  that  the  compenent  vectors  Ui  , Vi  are  linear  trans- 
formations. Accordingly,  they  will  be  presented  only  as  el- 
ements in  Hilbert  space.  The  proof  of  the  following  theorem 
Is  direct,  given  Theorem  3.2. 

Theorem  5.3.  Given  linearly  independent  »U-, . . . ,U„) 
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In  Hilbert  space  H , and  k vectors 

« SP<U£:1  - l,2,...,r> 

t-1,  2,...,k. 

Then  for  any  k-element  set  of  vectors 

'^r+l  » ^^r+2  *•••»  ^^r4k  ® ^ * 

there  is  one  and  only  one  r-element  set  of  vectors 


V,  , V,  e H 


such  that 


r4k 

s (U.1[V.)  - 0 , 
i-1  ^ ^ 

vdiich  holds  true  if,  and  only  if. 


(5.6) 


(5.7) 


S U4  ® V.  - 0 . 
i-1  ^ ^ 


(5.8) 


Moreover,  the  of  (5.6),  (5.7)  and  (5.8)  are  given  by 


f.  - , i - 1 , 2 

^ j-r  ^ J 


(5.9) 


The  case  R - I , the  identity. 

N 

It  is  known,  of  course,  that  if  S^(Uj^][V£)  - Ijj  , the 

identity  in  N-dlmenslonal  space,  then  it  suffices  that 

and  {U^}  is  an  orthonormal  basis.  Slightly  more 
general  is  the  condition  that  fU^}  and  (Vj^)  be  complemen- 
tary blorthormal  sets  (cf.  (3.3)).  But  Theorem  3.2  subsumes 
both  these  cases  and  presents  the  general  situation  as  follows: 

Theorem  5.4  (decompositions  of  the  identity).  Given  any 
spanning  set  > ^2  »..*»  Hilbert  space  H , i.e.. 
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sp<U^>  ■ H » where  dimension  H ■ r s N . Suppose  the  first 
r vectors  Uj  » ^2  U^.  for  a basis  for  H . Then  for 

n - r arbitrary  vectors 

» ^r+2  * * * * * ® ^ » 

there  is  a unique  r-element  set  of  vectors 

Vj  , V2 Vj.  € H (5.10) 

such  that 

N 

L (UjUV.)  ■ , the  Identity  on  H . 

i-1  1 1 r 

Moreover,  the  vectors  of  (5.10)  are  given  by 

V.  - U.  - E , 1 - 1 , 2 ,...,  r , (5.11) 

^ ^ j-r+1  ^ J 

where  the  scalars  are  defined  by 

U.  - S , j-r  + 1 , r + 2 ,...,  N . 

Remark.  The  context  of  Theorem  5.4  does  not  lend  itself 
to  an  interesting  dual  statement  via  Theorem  4.2,  unless  we 
are  Interested  in  when  the  sum  of  Kronecker  products 
produces  the  particular  rank  one  operator  0(lj.):z  -*  zl^.  , 
for  all  complex  z . 


; 

♦ 
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